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Abstract 

Parallel communicating systems of pushdown automata (PCPA) were 
introduced in (Csuhaj-Varju et. al. 2000) and in their centralized vari- 
ants shown to be able to simulate nondeterministic one-way multi-head 
pushdown automata. A claimed converse simulation for returning mode 
(Balan 2009) turned out to be incomplete (Otto 2012) and a language was 
suggested for separating these PCPA of degree two (number of pushdown 
automata) from nondeterministic one-way two-head pushdown automata. 
We show that the suggested language can be accepted by the latter com- 
putational model. We present a different example over a single letter 
alphabet indeed ruling out the possibility of a simulation between the 
models. The open question about the power of centralized PCPA working 
in returning mode is then settled by showing them to be universal. Since 
the construction is possible using systems of degree two, this also im- 
proves the previous bound three for generating all recursively enumerable 
languages. Finally PCPAs are restricted in such a way that a simulation 
by multi-head automata is possible. 



1 Introduction 

Parallel communicating systems of pushdown automata (PCPA) were intro- 
duced in [4] and some properties of such systems were shown. Among these are 
that general PCPA of degree two (number of components) and returning PCPA 
of degree three can generate all recursively enumerable languages. 

In [I] a proof was presented that centralized PCPA working in returning 
mode can be simulated by multi-head pushdown automata. More precisely, 
these PCPA of degree k (with k pushdown automata) were claimed to be simu- 
lated by nondeterministic one-way /c-head automata. Since the converse simu- 
lation had previously been shown in [3] , this would be an interesting character- 
ization in contrast to the universal power of other variants of non-centralized or 
non- returning PCPA (see [3] and Q] for further references). It would also link 
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the recent investigation of PCPA to classical automata theory dating back more 
than 40 years [S]. 

As demonstrated by Otto [5] , the proof from [T] is incomplete and the power 
of centralized PCPA working in returning mode is open. He defined a language 
that can be accepted by centralized PCPA of degree two working in returning 
mode for which the simulation given in [T] fails. 

The main purpose of the present paper is to elaborate on the observations 
from [5] about the inherent synchronization of PCPAs and settle the open prob- 
lem resulting from the gap in pQ. First we show that the language from [5] on 
which the simulation fails can be accepted in a way deviating substantially from 
the suggested simulation by a nondeterministic two-head pushdown automaton 
(in [5] it is stated without proof that four heads are sufficient for this task). Since 
for degree two this is the claim of [T], the language cannot serve as a witness 
showing the claimed result to be incorrect. In order to obtain a concrete coun- 
terexample we show that a non-regular language over a single-letter alphabet 
can be accepted by a centralized PCPA in returning mode. By a classical result 
such languages cannot be accepted by one-way multi-head pushdown automata. 

We then present the main result that centralized PCPA of degree two work- 
ing in returning mode are universal, placing them among the formally more pow- 
erful systems mentioned above. It also improves the result that non-centralized 
PCPA of degree three can accept every recursively enumerable language [4, 
Theorem 4] and answers several open problems from Section 5 of [1]. Next we 
restrict the PCPA to linear time and give a simulation by multi-head pushdown 
automata in the spirit of 1 . This simulation is probably not tight, since it uses 
more heads than the degree of the PCPA and makes use of sensing (detecting 
coincidence of heads) . 



Several variants of PCPA were defined in [HQ]. Informally, a PCPA of degree k 
consists of a collection of k nondeterministic pushdown automata in the classical 
sense. These automata (called components) work in a synchronous fashion 
reading the same input string. Note that by epsilon-moves on the input the 
components can process the input at different speeds. Communication is carried 
out via special pushdown store symbols. If one of these symbols is on top of a 
pushdown store, instead of a usual step the contents of another pushdown store 
are copied to the pushdown store replacing the topmost symbol. If the PCPA 
is working in returning mode, the source pushdown store is emptied up to a 
bottom symbol. The PCPA is centralized if only one component (say the first) 
can use communication symbols. An input is accepted if all components have 
read the entire input string and reach final states. 

We also give a formal definition of PCPA since we will need it for a concrete 
example. A PCPA of degree k is a tuple 



2 Preliminaries 



A = (V,A,A 1: A 



2. 



...,A k ,K) 



where 



• V is a finite input alphabet 



• A is a finite alphabet of pushdown symbols, 
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• Ai is a component as defined below for 1 < i < k, 

• K = {K\, . . . , K k } C A is a set of query symbols. 

Each component Ai = (Qi,V, A, fi,qi, Zi, F{) is a pushdown automaton 
where 

• Qi is a finite set of states, 

• /i is a function from Q.; x (V U e) x A to the finite subsets of Qi x A*, 

• Qi € Qi is the initial state, 

• Zi G A is the bottom symbol, 

• Fi C is the set of final states. 

If only function /j of the first component maps to sets with members containing 
query symbols, the system is called centralized. 

A configuration of a PCPA of degree A: is a 3/c-tuple 

{si,X!,ai, . . . , s k ,x k , a k ) 

where 

• Si 6 Qi is the state of component Ai, 

• Xi G V* is the part of the input not yet processed by Ai, 

• ai G A* is the word on the pushdown store of Ai with its topmost symbol 
on the left. 

In returning mode the step relation h r between configurations is defined by: 

(si,xi,Biai, . . . , s k ,x k ,B k a k ) h r (s[ , x[ , a[ , . . . , s' k , x' k , a' k ), 
if one of the following conditions holds: 

Internal step: {Bi, B k } n K = 0, x t = a i x' i with a* G V U {e}, (s-, /3) G 
fi(si,ai,Bi) with a- = /3aj. 

Communication step: {B\, . . . , B k }nK ^ 0, for each Bi = Kj i with Bj t K 
we have = B^ctj^i, a'j. = Zj t , and a' m — B m a m for all other indices 
m. States and input are not modified: = Si and x[ = Xi for 1 < i < k. 

The PCPA accepts exactly those words w that admit a sequence of steps from 
the initial configuration 

(qi,w,Zi, . . .,q k ,w,Z k ) 

to a final configuration 

(si,e,ai, . . . ,s k ,e,a k ) 

with Si G Fi for 1 < i < k. 

A nondeterministic one-way multi-head pushdown automaton has k read- 
only heads it can move forward on a single input tape and one pushdown store. 
In some constructions we assume that the input-heads are sensing (they can 
"see" each others when they scan the same position). This is a variant of the 
model investigated in [3] . Formal definitions of these automata can be found in 
[5j [9j S] . In the first reference input-tapes have end- markers and we also assume 
this here. When we mention multi-head pushdown automata we always refer to 
the one-way variant in the present paper. 
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3 Results for General Centralized PCPA 



We start our investigation with the language defined in [5] and show that it 
can be accepted by the type of automata proposed in [I] for a simulation of 
centralized PCPA working in returning mode. Notice that this does not mean 
that the simulation works, since our algorithm deviates from the simulation of 
PQ as outlined for this specific language in 8.. It can however be deduced that 
a different witness language is necessary to show that the claim of pQ in general 
fails. 

Theorem 1 Language L = {uvu v u R \ u, v £ {a, b} + , \u\ = \v\} (where w R is 
the reversal of string w ) from J8)j can be accepted by a nondeterministic two-head 
pushdown automaton. 

Proof. We first describe the algorithm carried out by a nondeterministic two- 
head pushdown automaton. 

1. While moving head 1 forward, push a non-empty prefix x of the input w 
onto the pushdown store. The head stops at a nondctcrministically chosen 
position. 

2. Move head 2 over the input counting the number of steps using a special 
counting symbol. Head 2 stops at a nondeterministically chosen position. 

3. Move head 1 and head 2 in parallel over the input at least one position 
and compare the symbols read. Also pop four counting symbols for each 
step and repeat until all counting symbols have been removed. Reject the 
input in one of the following cases: 

• A head reaches the end-marker before all counting symbols have been 
removed. 

• The symbols read by head 1 and head 2 are not equal. 

• The remaining number of counting symbols in an iteration is between 
1 and 3 (which means that the initial number was not divisible by 
4). 

• Head 2 has not reached the end-marker when all counting symbols 
have been removed. 

4. With the help of head 1 compare the contents of the pushdown store to 
the remaining part of the input. 

5. Check that the end-marker is reached exactly when the pushdown store 
becomes empty and accept. 

Clearly every string in L can be accepted by the algorithm described above. 
On arbitrary input w with \w\ — n, a prefix a; of it; is first pushed onto the 
pushdown store. Then a suffix y of the input is compared to a section of equal 
length after x. By counting on the pushdown store the automaton ensures 

\y\ = (M - |y|)/4 

and thus 

\y\ = M/5. 
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Suppose that the copies of y being compared overlap. Then \x\ > \w\ — 2\y\ — 
3\w\/5 > \w\/2 and the last comparison will fail. Therefore we can assume that 
w = xyzy and in case of acceptance x R — zy. It follows that |x| = 2|w|/5, 
\z\ = \w\/5 and by letting u = y R and v — z R we see that the input 



Next we present a non-regular language accepted by a centralized PCPA of 
degree two working in returning mode. This improves the construction from [4, 
Example 1] where the same language was shown to be accepted by a similar 
non-centralized system of degree four. At the same time it will serve as one 
building-block of a proof that the main claim from [T] is incorrect. 

Example: The language {a 2 \ n > 1} can be generated by a centralized 
PCPA of degree 2 working in returning mode with the following transitions of 
its components: 



Initial states are q$ and final states are Fi — {q 2 } and F 2 — {q 2 }- 

We outline the idea of the construction. First both components read a single 
a. Then component 1 reads as many input symbols as indicated by the size of 
its pushdown store. Component 2 in parallel pushes approximately twice as 
many symbols, with the exception of the first step since the bottom symbol is 
already present. This process ends when the pushdown store of component 1 is 
empty. Then the contents of the pushdown store of component 2 is copied and 
the process is repeated. 

Component 2 stays in its final state after the first step. Therefore acceptance 
depends on component 1, which is in a final state after the pushdown store has 
become empty. This happens after reading 



w = xyzy = (zy) yzy = y z yzy = uvu v u 



belongs to L. 



□ 



fi(ql,a,Zi) 
fi(ql,a,a) 

fx(q\,a,Zi) 
fx(q\,a,a) 

fi(q2,a,a) 
fi(qo,a,Zi) 

fi(qo,a,a) 
f 2 (ql,a,Z 2 ) 

f 2 (ql,a,a) 



{(<?! 

{(qI 
{(ql 
{(ql 
{(ql 

{{ql 
{{ql 




k 



1 + 2 ' = 2 



,fc+l 



i=0 



input symbols for some k > 0. 

We consider the computation on a 8 : 



[qQ,a 8 ,Z 1 ,ql,a 8 ,Z 2 ) \- r (q\,a 7 ,Z-L,(fi,a 7 ,Z 2 ) r> 
(ql,a 6 ,K 2 ,ql,a 6 ,aZ 2 ) h r (ql, a 6 , aZ u qf, a 6 , Z 2 ) r> 
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{ql,a 5 ,Zi,ql,a 5 ,aZ 2 ) h r (ql,a 4 ,K 2 ,qf,a 4 ,aaaZ 2 ) h r 

(q 2 ,a 4 ,aaaZi,qf,a 4 , Z 2 ) r> (<Zf , a?, aaZ±, q 2 , a 3 , aZ?) h r 

(q\, a 2 , aZ\, q 2 , a 2 , aaaZ 2 ) r> (li: a i Z\,q\,a,aaaaaZ-z) l~r 
(qle,K 2 ,q 2 ,e,a 7 Z 2 ) 

Since in the last configuration all components have read the entire input and all 
states are final, the word a 8 is accepted. 

The following result [5J Theorem 4.2] shows a limitation of pushdown au- 
tomata: 

Fact 1 The single-letter alphabet languages accepted by nondeterministic multi- 
head pushdown automata are the regular languages over single-letter alphabets. 

The more general result that bounded languages accepted by bounded-reversal 
multi-head pushdown automata are semilinear has been shown in [6]. 

Notice that a statement analogous to Fact [T] about automata with sensing 
heads is not true. The above language can be accepted by a deterministic 
pushdown automaton with two sensing heads that keeps doubling the distance 
between the heads using its pushdown store as a counter. 

The language in the example above is not regular, therefore we obtain: 

Observation 1 No general simulation of centralized PCPA of degree two work- 
ing in returning mode by nondeterministic multi-head automata is possible. 

We can also conclude that Theorem 8 of [1] (which is weaker than his Theorem 5) 
is wrong, since the system in the example above is simple. A simple system 
as defined in [T] has no two components querying the same component and 
components that query do not communicate to any other querying component. 
For a simple centralized PCPA A working in returning mode Balan claimed in 
his Theorem 8 that the accepted language L(A) could be written as 

L(A) = L(Mi) n L(M 2 ) n • • • n L(M m ), 

where every Mi is a multi-head automaton. Since regular languages are closed 
under intersection and over a single letter alphabet each L(Mi) is regular by 
Fact [2 this claim contradicts the example (we could also argue that languages 
accepted by multi-head automata are closed under intersection, where the num- 
ber of heads required for the intersection is at most the sum of the heads for 
the languages in the intersection). 

After the basic separation of the models claimed to be equivalent in pQ, it 
remains to be investigated how powerful centralized PCPA working in returning 
mode really are. The following result gives an answer and improves the previous 
bound three for non-centralized systems [4]. 

Theorem 2 Every recursively enumerable language can be accepted by a cen- 
tralized PCPA of degree two working in returning mode. 

Proof. One register machines with the operations multiplication and conditional 
division by 2 or 3 are universal, see Theorem 14.2-1 of 7[. We will outline a 
simulation of such a machine with input tape by a PC system of two pushdown 
automata. 
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Component 1 carries out the main task of the simulation. For every in- 
struction of the register machine, an in general unbounded number steps of the 
pushdown automaton will be carried out. On its pushdown store a counter is 
simulated. 

Component 2 constantly works in a cycle of length 6, pushing a single count- 
ing symbol in every cycle. If the top-most symbol on the pushdown store is the 
bottom symbol, it is kept and the first counting symbol is pushed after six 
steps. Then the cyclic behaviour starts. 

We will first outline how a reset to an empty pushdown store of component 2 
can be enforced by component 1. The difficulty is that a communication step 
transferring the contents of the pushdown store of component 2 to component 1 
empties the pushdown store of component 2 but possibly puts "garbage" gener- 
ated in previous steps on top of the pushdown store of component 1. Therefore 
component 1 repeatedly carries out the following process: 

• A communication step from component 2 to component 1. 

• Component 1 checks whether the top-most symbol of its pushdown store 
is the bottom symbol transferred from component 2. If so, the symbol is 
removed and the process is terminated. 

• Otherwise a loop of component 1 starts that removes one symbol from 
the pushdown store in each iteration, stopping after the bottom symbol 
transferred from component 2 has been removed. 

Note that each execution of the process reduces the number of counting 
symbols on the pushdown store of component 2 by at least a factor of 6. Thus 
eventually only the bottom symbol is transferred from component 2 leaving its 
pushdown store empty and the pushdown store of component 1 unchanged. 

Now we are ready to describe the simulation of register machine instructions 
by component 1: 

Read a symbol from the input tape: Carry out transitions reading input 
without changing the pushdown store. 

Multiply by 2 (3): Reset the pushdown store of component 2. Then carry 
out a loop of length 12 (18) that removes one counting symbol from the 
pushdown store in each iteration. Finally the bottom symbol is replaced 
with the communication symbol and the pushdown store is transferred. 

Divide by 2 (3): Reset the pushdown store of component 2. Then carry out a 
loop of length 3 (2) that removes one counting symbol from the pushdown 
store in each iteration. Determine the remainder by the state when the 
bottom symbol is read and replace it with the communication symbol. 

If the register machine accepts its input, component 1 enters an accepting state 
and we let all states of component 2 be accepting. □ 

Clearly every language accepted by multi-head pushdown automata is decid- 
able, therefore we obtain another separation of PCPA and this computational 
model in addition to Observaition [T] From the known hierarchy results [51 [3] 
the concrete example 

L' = • ■ • #w n $w' n # • • • #w' x | Wi ^ w'i for some i} 

can be derived p2 proof of Theorem 2] that separates the classes. 
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4 Results for Time-Bounded Centralized PCPA 



In view of the impossibility of simulating centralized PCPA working in returning 
mode by multi-head pushdown automata we explore in this section restrictions 
of PCPA that admit a simulation. 

See [9J Theorem 13.15.8] for a proof that there is no loss of generality in 
requiring a linear time bound for multi-head pushdown automata. Since the 
construction from the proof of [H Theorem 5] gives a system accepting in a 
time proportional to the automaton being simulated, we obtain the following: 

Observation 2 Every k-head pushdown automaton can be simulated by a cen- 
tralized PCPA of degree k working in returning mode and accepting in linear 
time. 

This raises the question, whether a result in the spirit of the simulation of 
PQ is possible when restricting the time bound of PCPA to being linear. We 
were not able to give a characterization but present here a partial result that 
uses additional heads exceeding the degree of the system. We also assume that 
the heads are sensing. Observe that such automata are stronger than their 
counterparts with non-sensing heads as pointed out after Fact [TJ 

Theorem 3 Every centralized PCPA of degree k working in returning mode 
and accepting in linear time is simulated by a 2k-head pushdown automaton 
with sensing heads. 

Proof. Let the PCPA accept in at most cn steps on inputs of length n for some 
constant c. The heads of the simulator are divided into two groups. Heads of the 
first group simulate the access to the input for the k components of the PCPA. 
Heads of the second group serve a clocks measuring the number steps carried 
out by the components being simulated. The multi-head automaton simulates 
the first component of the PCPA step by step until communication occurs. 
It also records the current state of each of the other components. For every 
step being simulated the clock for component 1 is advanced by one counting 
modulo c in the finite control and recording each iteration of this counting 
process by advancing the input head. If communication with component i > 1 
takes place, the component i is simulated starting at the currents state using 
its input head and clock until the clock of component 1 and i coincide and 
the simulation of component 1 continues. This can be detected by the sensing 
property. The pushdown store of component i is simulated on top of the contents 
of the current pushdown store. The first phase of the simulation is terminated 
if component 1 accepts or if the clock reaches cn. Notice that in the latter case 
the simulator can reject the input, since by definition all components have to 
accept. If component 1 accepts, the simulator simulates the remaining k — 1 
components in turn until each of them has executed the same number of steps 
as component 1. The input is accepted if all components accept. □ 

When all components of a PCPA read their input synchronously, we can 
identify heads accessing the input and clocks for each component. We obtain the 
following result by basically the same simulation as in the proof of Theorem [31 

Theorem 4 Every centralized PC system of pushdown automata of degree k 
working in returning mode without e -transitions on the input can be simulated 
by a k-head pushdown automaton with sensing heads. 
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5 Discussion 



We have settled the open problem about the power of centralized PCPA of de- 
gree two working in returning mode from |4 ; , 8 by showing them to be universal. 
This also improves the previous bound three for generating all recursively enu- 
merable languages with non-centralized systems and solves several open prob- 
lems from Section 5 of [4]: 

1. PCPA of degree two working in returning mode are as powerful as those 
of degree three. 

2. Centralized systems can accept all recursively enumerable languages. 

3. The inclusion of [H Theorem 5] referring to returning mode is strict and 
becomes a corollary of our main result. 

4. The degree hierarchy for centralized PCPA working in returning mode 
is finite, with the context-free languages at level one and the recursively 
enumerale languages at all other levels. 

The simulation of register machines is deterministic, an aspect that is mentioned 
at the end of Section 5 of [3] . In hindsight the power of these systems is surpris- 
ing, since the claim of [1] would have implied decidability even in linear time on 
nondeterminstic Turing machines [9J Theorem 13.15.8]. 

In addition we described simulations of restricted PCPA by multi-head au- 
tomata in the spirit of [T] . The optimality of the simulations in terms of input 
heads remains an open question as well as the possibility of a converse simula- 
tion, since we required the heads to be sensing. We expect that Observation [2] 
can be strengthened in this direction. 
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